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What Made Apollo a Success? 




• A clear and compelling goal that came from the top 

• Sufficient resources to accomplish it 

• A systems approach to managing complexity 

• The optimum solution could win 

• Reduced risk by designing for simplicity and 
redundancy 

• Test, test, test under flight conditions 

• What-if thinking 

• Accountability at all levels of the program 

• Luck 


Management Lessons of the Moon Program - Andrew Chaikin 
https ://www.voutube.com/watch?v=RaskWhv5pYE 


NASA’s Budget History 
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NASA's budget as percentage of federal total, 
from 1962 to 2014 (projected) 
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Systems Engineering 
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“The objective of systems engineering is to see to it that the system is designed, built, and 
operated so that it accomplishes its purpose in the most cost-effective way possible, 
considering performance, cost, schedule and risk.” 

NASA Systems Engineering Handbook SP6105 
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• Systems engineering is a methodical, disciplined approach for the 
design, realization, technical management, operations, and retirement of 
a system. 

• A “system” is a collection of different elements that together produce 
results not obtainable by the elements alone. 

• Elements can include people, hardware, software, facilities, policies and 
documents. 


• All things required to produce system level results. 

Systems engineering is the art and science of developing an operable 
system capable of meeting requirements within imposed constraints. 

• Not dominated by the perspective of a single discipline. 

• Is the responsibility of engineers, scientists, and managers working on NASA 
missions. 


The Tree Swing Project 




What the PM 
envisioned 


How the engineer 
saw it 



What the 
customer wanted 



^fter CDR... 


What the project 
was going to cost 


What the project 
could afford 



How the 
requirements 
were documented 



What the PM 
prayed for 



After PDR... 



What the 
scientists really 
needed 
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stakeholder Needs 
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Why “They” Don’t “Need” the 







• It’s more fun to design and build the system 

• This is the next widget in a series, we just need to 
make a few tweaks 

• It’s an “in-house” build, we’ll just tell the designers 
what we need 

• We don’t have time 

• We don’t need the process, we know what we’re 
doing 

• The process will hinder innovation 


What “They” Do 

• Copy requirements from past systems 

• Develop requirements without proper systems 
engineering 

• Develop requirements in parallel with trade studies 
and Concept of Operations 

• Proceed to design and build the system without 
requirements 


What Happens 


• Systems that meet requirements but fall short of 
meeting customer expectations 

• Systems that are difficult to verify 

• Systems with interface issues 

• Projects cancelled due to failure to stay within 
budget and schedule limitations 


Pay Me Now or 
Pay Me More Later 




Source; Industry studies 
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Project Overruns 




Percent of Project Resources Spent in Phase B 
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Typical NASA Project Life Cyc 


NASAUfe^ 

Cycle 






FORHiJLATIOM 



Mi.( MENTATION 


Pio^ 

Llle^Cytle 

Ptueee 


Pfe>PlMf«A: 

Cor>ce^ SMtt 


■WT 


PheteA: 

Cof^aislA 

T•c^nol09/ 

Dfvflopmert 


^7 

nlnirj^ 


PheteB: 

PrtliAinirYOesignS 
Technology 
CompieMon 


\7 


^7 


PtvmC: 

FmeiOeeignA 

Febricelion 


^7- 


PtMteO: 

SyetM 

IniegrieonATeN. 

LeuichSCtveclooul 


V 

leunch 

A 


Phetel: 

Operdlonsft 

SustMomen 


77 


PtueeF: 

CIOSMI 


Pio^Ltfe-Cycle 

Cete^ 

Documente^jfMl 

MiiotEvcnie 


KDP0 


KDPC 


KDPO> 


KDP e 


KDPF 


fPO 
Preitml 
Pfoied / \ 


Prelifniniry 

Pwi«ct A 

Pltfi LA 


Beeeiine 
Project A 
P\m LA 


ErxlOtM4»io) 


Fmel 

Archivel 
of Dale 


A 


7T 

ASM' 


A96fKy 


Humm Space 
F ligtit Pi ofect 
UFe^Cycte 
Reelewre^ 

R»A»(pes 

RolMAk Motion 
Pto^ ttfe 
Cycle 

u 


Othof 


SnppoftVHI 


MCR 


A 

MCR 


SRR SDR 


POR 


cycle pheet If modloMone ^ 
ere needed beheeen ligfil) 


A ii 

COR I ^ 

pim» 


SRR UOR^ 


A 

POR 


A AZ\ 


ORR FRR PI 
Inapectionscnd 
RetrtMahfMTt ^ 

I 


t>iR 


A 

CERR‘ 


z, 

DF 


EfKfOf 
Flight t 


A ii 


COR/ 

PRR* 


SI? 


A 

ORR MRR 


A/\ 


PLAR 


PFM? 

A 4 

CERR‘ Of 


A 

ORR 


A 

ORR 


A, 


Av^; 


SR^LRR 

i.FSR(LV) 


/^\ Peer Reviews. Subsystem PDRs. Subsystem CDRs, end System Reviews /\ 
1 — . 1 _j _ 


FOOTNOTES 
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ACRONYMS 

ASM • Acqijsdion Strategy Meebng 

COR • CnbcM Design Review 

C€RR • Cnecat E ventsReadinessRevierv 

DR •Oecomrnlssmng Review 

ORR •OlspoaeiReedinessRevlew 

F A - F ormilabon AgreemerS 


MDR • Mission OeSrVbon Review 
MRR -MissKinReednessRevlew 
ORR -OperMionilReedness Review 
POR -PraliiMniryOesignRevitw 
Pf 4R •Posl-Fli^ AssessmeitRevirw 
PtAR - Posl-Leunch Assetsmert Rewtw 
PRR -ProducbcnReedneesReview 


F AD • F oneiiabon AithoruMon Oocufiift 

F RR • FughlReedintssReview 

KDP • Key OeosH>n Port 

LRR • launch ReedinessRewaw 

IV- leuKh Wkiide 

MCR -Mission Concept Review 


S4R -System Acceptance Review 

SOR • SyMem Oetmeon Review 

9R - System Integrabon Review 

SMSR - Selety and Mission Success Revww 

SRB - Slandmg RevlewBoerd 

SRR • SysMm RequrementsReview 


▲ Redtnandesrspresertiils^dtreviewstielraqueeSRBs TheOecoionAUhciity. 
4dminMbrMor.MDAA.Of CerSerOireclor My requeSttheSRBlo concUct other reviews 


System Hierarchy 
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Why Follow the SE Process? 

• Ensure that you deliver the right system that 
meets your customer’s vision 

• Avoid scope creep and gold plating 

• Bound your system to fit your cost and schedule 
constraints 

• Minimize change traffic that results in increased 
costs and delays in the schedule 


Delivers a system that meets your customer’s 
vision on time and on budget... 
leading to increased shareholder value. 


How do you get there? 

• Define the vision of your system 

• Develop a Concept of Operations to capture the system 
vision 

• Secure stakeholder agreement on the vision 

• Perform trade studies to determine optimal system solution 

• Develop requirements documenting characteristics, 
features and functions that your system must have in order 
to meet the Concept of Operations 

• Validate the requirements 

• Design and build the system 

• Verify the system meets requirements 

• Validate the system meets stakeholder needs 

• Document, deliver and operate the system 
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Lesson Captured 



Case 

C* 


? # 


APOLLO EXPERIENCE REPORT - 
GUIDANCE AND CONTROL SYSTEMS 

Raymond E. Wilson , Jr. 

Lyndon B. Johnson Space Cen/er 
Homion, Texas 770^8 


0 - 8^49 



NAIIDMAt AERDKAUTICI AND fPACE ADHINISTRATIOM ' WASHINGTON, D. (. ' JUNE 


Apollo 1976 


CONCLUD ING REfVWRKS AND RECOMMENDATIONS 


During th# courts of tl^e d^fvelopmertt, and fligtit programs ^ the 

Apollo gutdancfr and conU^il systfiniB perfonsitd in sm ttutasiSmrfiim manner, Thero wore 
no gukiaiicEi and control failuroE or malEyncticiiis that pr£ctud«d itilashon cnmpl^tlon or 
that placed Ute flight ero‘4 or the mission in jeopardy. 


Ill general j, the approaches that were used to estahLlah arid irop]em.«nl: guidance arid 
COiUiOl E^psiem Interfacee and checkout procedures during the Integration of the ayst^ms 
In Ihe spa<Lecrift ippear to have hecn sound r C-Onsequently, few interface pj-oblems 
appeared dluringthe Integration of the systems Intotho spaos^^raft, the more 

Sl^iikant items that deserre careful consLde-ratlon on future program e are folLows^ 


t. A strong effort should he mads Us estahlish h4*cUns requirements b&fore th* 
Etart of hardware design and software development processed- .Por evasnpie, changes 
affecting hand coat rollers^ humidity^ and in-Hlght malnteoanoe caused majo-r redesign 
efforts. 

2. A failure-analysis technt 
of dingle -point failures. The ApoLLi 
diagrams (or problemE, id not altug 


^ developed to aasl^ In the Identlflcatlou 
1 which many engineers must search 
!salul for oomplex systeins. 


A strong effort should be made to 
establish baseline requirements before 
the start of hardware design and software 
development processes. For example, 
changes affecting hand controllers, 
humidity, and in-flight maintenance 
caused major redesign efforts. 
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System Configuration 
Management 



• Initially a tough sell on the Apollo Program 

• Maintaining system configuration control is 
essentiai to controiling cost and scheduie 

• Configuration management doesn’t mean that you 
can’t change it... it means you define at each stage 
of the game what you think the design is going to 
be within your present abiiity. The difference is 
after you describe it you know what it is when you 
change it. - George Muelier 


NASA and System Engineering 




• Agency Requirements and Guidelines 

• NPR 7123.1B NASA Systems Engineering Requirements and 
Processes 

• Systems Engineering Handbook 

• Formal Training 

• Academy of Program/Project and Engineering Leadership 

• Systems Engineering Leadership Development Programs 

• Center Level Programs 

• Mentoring and on-the-job training 

• Case Studies 

• SE Forums 
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A Lesson from Apollo 


In the huge, complex 
group endeavor that is 
space flight, human 
nature is as critical as 
engineering principies. 
Neither can be ignored 
without inviting faiiure. 

-Andrew Chaikin 




Personality Traits of SEs 


Great Systems Engineer 


Intellectual Curiosity 


Appreciation 
for Processes 



Good Systems 
Engineer 




Understands 

Connections 


Communicator 


Proper Paranoia 


Strong Technical 
Background 


Good Leader 


Comfortable 
with Change 

Self Confidence 
& Energy 


Comfortable 
with Uncertainty 


Understands Resources 
& Margins 



Has Big Picture View 


SE and PM Leadership 


Requirements Definition 
Trade Studies 
Technical Solution 
System Analysis & Integration 
Verification & Validation 
Technical Management 
Technical Planning 
Technical Control 
Technical Assessment 
Technical Decision Analysis 


Planning 
Risk Management 
Configuration Mgmt 
Data Management 
Feasibility Assessment 
Decision Analysis 


Management Planning 
Schedule Management 
Integrated Assessment 
Resource Management 
Acquisition Management 


Final Thoughts 

• Following SE best practices is the key to ensuring 

• The system will meet your customer’s needs 

• The system will be delivered within the cost limit 

• The system will be delivered on time 

• It’s not Rocket Science if you follow Systems 
Engineering Best Practices 



Additional Resources 



. NPR7123.1B 

http://nodis3.asfc.nasa.aov/displavDir.cfm?t=NPR&c=7123&s 

=1B 

• NASA SE Handbopk - http ://www. aca . osd . m i l/se/dPcs/N AS A- 
SP-2007-61 05-Rev-1 -Final-31 Dec2007.pdf 

• NASA APPEL - http://appel.nasa.gov/ 

• Management Lessens of the Moon Program - Andrew 
Chaikin - https ://www.voutube.com/watch?v=RaskWhv5pYE 

• So you want to be a systems engineer - Gentry Lee 
http://spacese.spacearant.org/index. php?paae=videos 

• Additional SE information and case studies 
http://spacese.spacearant.ora/index.php?paae=presentations 
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